View Maintenance using Partial Deltas

نویسندگان

  • Thomas Jörg
  • Stefan Deßloch
چکیده

This paper addresses maintenance of materialized views in a warehousing environment, where views reside on a remote database. We analyze so called Change Data Capture techniques used to capture changes (also referred to as deltas) at the source systems. We show that many existing CDC techniques do not provide complete deltas but rather incomplete (or partial) deltas. Traditional view maintenance techniques, however, require complete deltas as input. We propose a generalized technique that allows for maintaining a class of materialized views using partial deltas.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

DBToaster: A SQL Compiler for High-Performance Delta Processing in Main-Memory Databases

We present DBToaster, a novel query compilation framework for producing high performance compiled query executors that incrementally and continuously answer standing aggregate queries using in-memory views. DBToaster targets applications that require efficient main-memory processing of standing queries (views) fed by high-volume data streams, recursively compiling view maintenance (VM) queries ...

متن کامل

Restructuring View Maintenance Plans for Large Update

Materialized views defined over distributed data sources are a well recognized technology in data integration, e-business and semantic web. Due to the constantly increasing size of the information sources and the rapid rates of change, there comes an increasing pressure to reduce the time taken for refreshing such integration views. State-of-the-art incremental view maintenance literature requi...

متن کامل

Real-Time Snapshot Maintenance with Incremental ETL Pipelines in Data Warehouses

Multi-version concurrency control method has nowadays been widely used in data warehouses to provide OLAP queries and ETL maintenance flows with concurrent access. A snapshot is taken on existing warehouse tables to answer a certain query independently of concurrent updates. In this work, we extend this snapshot with the deltas which reside at the source side of ETL flows. Before answering a qu...

متن کامل

Maintenance of Automatic Summary Tables in Ibm Db2/udb

Materialized views are commonly used to improve the performance of aggregation queries by orders of magnitude. In contrast to regular tables, materialized views are not directly updateable by the user, but are indirectly synchronized by the database system itself. In this paper we present an overview of the maintenance strategies for ‘Automatic Summary Tables’, the materialized view implementat...

متن کامل

On Graph Deltas for Historical Queries

In this paper, we address the problem of evaluating historical queries on graphs. To this end, we investigate the use of graph deltas, i.e., a log of time-annotated graph operations. Our storage model maintains the current graph snapshot and the delta. We reconstruct past snapshots by applying appropriate parts of the graph delta on the current snapshot. Query evaluation proceeds on the reconst...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011